Cognition Labs

Cognition Labs launched Devin, the 'first AI software engineer,' in March 2024 with a benchmark score of 13.86% on SWE-bench, but independent evaluations later showed it failed 14 out of 20 real tasks…

Current large language models cannot safely modify real software systems despite impressive code-generation demos, because they rely on pattern matching rather than causal reasoning. The fundamental g…